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Abstract 

Dynamics on networks are often characterized by the second smallest eigenvalue of the Laplacian 
matrix of the network, which is called the spectral gap. Examples include the threshold coupling 
strength for synchronization and the relaxation time of a random walk. A large spectral gap is usually 
associated with high network performance, such as facilitated synchronization and rapid convergence. 
In this study, we seek to enhance the spectral gap of undirected and unweighted networks by removing 
nodes because, practically, the removal of nodes often costs less than the addition of nodes, addition 
of links, and rewiring of links. In particular, we develop a perturbative method to achieve this goal. 
The proposed method realizes better performance than other heuristic methods on various model and 
real networks. The spectral gap increases as we remove up to half the nodes in most of these networks. 
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I. INTRODUCTION 



Various systems of interacting elements can be represented by networks that consist of a set of 
nodes and links that connect pairs of nodes. The structure of networks affects various dynamics 
occurring on the networks ]J-|3|.In particular, many dynamics on networks are controlled by 
a few extremal eigenvalues of the adjacency matrix and the Laplacian matrix of the network 
(see Sec. [Ill for the definition of the Laplacian matrix). The values of these eigenvalues provide 
concise and useful information about the dynamics on the networks. 

In this study, we focus on the second smallest eigenvalue of the Laplacian matrix; it is called 
the spectral gap and is denoted by A2 in this paper. We examine A2 because it characterizes 
a wide class of dynamics on networks as follows. First, a network with a large value of A2 



decreases the threshold of coupling strength for synchronization for 
some nonlinear dynamics including coupled oscillators on networks 



30th linear dynamics and 
lHg, |8[. Such a family of 
nonlinear dynamics is called the class II or type II |4[ dynamics. Note that the largest 

Laplacian eigenvalue as well as Ao is an important determinant of the synchronizability in the 
so-called class III [2, 9] or type I dynamics. However, we are not concerned with class III or 
type I dynamics in this paper. Second, when A2 is large, synchronization in these dynamics 
and consensus dynamics 10| occur rapidly in certain types of networks. Third, A2 characterizes 
the convergence speed of the Markov chain on the network to the stationary density 
Fourth, the first-passage time of the random walk is characterized by A2 js|. Fifth, the duality 
between the coalescing random walk and the voter model 12( implies that A2 also determines the 
consensus time of the stochastic voter dynamics. This is in agreement with the results obtained 
for the majority- vote spin dynamics on networks In addition to these dynamical properties 
of networks, various graph-theoretical structural properties of networks are characterized by A 2 
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In these applications, a large value of A2 is usually preferred because it indicates, for example, 
enhanced synchronizability and fast convergence. Consequently, the enhancement of A2 has 
been explored in the framework of designing of networks {(], Q] and numerical optimization 
via the rewiring of links In practice, however, rewiring links, constructing optimized 

networks from scratch, and adding nodes or links are likely to cost more than the removal 
of nodes or links of a given network. The effects of removal of nodes or links have been 
investigated in the context of the cascading failure 15[ and the influence on extreme eigenvalues 
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of the adjacency matrix 161 ] . With regard to Laplacian eigenvalues, the removal of links always 
decreases A2 and makes the network less likely to synchronize jl7l. However, to the best 
of our knowledge, whether or not careful removal of nodes may increase A2 has not yet been 
examined. We treat this problem in the present paper. 

Although removal of nodes generally decreases the magnitude of activities, stabilizing syn- 
chronization at the expense of the magnitude is valuable in some applications. The treatment of 
cardiac arrhythmia is one of the examples. The heart consists of a large number of cardiac cells 
that show nonlinear dynamics 19| . Synchronized dynamics of cardiac cells create physiological 
heart beats {20 1. Cardiac arrhythmia is considered to be caused by malfunction of synchro- 
nization. The catheter ablation aims at restoring synchrony of the entire heart by electrically 



deactivating some cardiac cells that prevent synchronization [2l|. As another example, proper 
operations of power plant networks also critically require that the frequency of voltage among 
power plants is synchronized 22J, |23| . Loss of the synchronization may induce a blackout in the 



entire network. Therefore, it is likely that stable synchrony at the expense of some total power 



22|. 



supply serves steady supplying of electricity to the entire network 

We compare various strategies for maximizing A2 by sequential node removal on various 
model and real networks. In particular, we develop a perturbative strategy that is applicable 
to relatively large networks in terms of the computational cost. We show that the performance of 
the perturbative strategy is comparable to that of the computationally costly optimal sequential 
strategy and is generally better than that of heuristic strategies. In addition, in many examined 
examples, A2 continues to increase until we remove a fairly large fraction of nodes (~ 50%) 
sequentially according to the perturbative strategy. 



II. STRATEGIES FOR SEQUENTIAL NODE REMOVAL 

We consider undirected and unweighted connected networks with N nodes. The Laplacian 
matrix L is defined as follows. (1 < i ^ j < N) is equal to —1 if node i and j are connected 
and otherwise; L is a symmetric matrix. The diagonal is given by La = k iy where ki is the 
degree of node i. Note that X^=i = ® f° r eacn L has N (real) nonnegative eigenvalues 
= Ai < A2 < ■ ■ ■ < Ajv. We seek to maximize A2 upon sequential removal of nodes. We 
compare the effectiveness of the following node removal strategies by applying them to model 
and real networks. 
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Degree-based strategy: In each step, we remove the node with the smallest degree in the 
remaining network. The rationale behind this strategy is that the smallest degree controls 



A2, with a use 
the network 



ul bound being A2 < k min N/(N — 1), where k m[n is the smallest degree in 



(4, [ll, Q|- If there exist multiple nodes having the same smallest degree, we 
select one of them with an equal probability. 

In intentional attacks on networks, where the aim is to fragment the network into disjoint 
components with a small number of removed nodes, removing nodes with the largest 



degree is an effective strategy 



24J. We implemented this strategy but obtained poor 



results for our purpose, and therefore we do not mention it in the following. 

Betweenness-based strategy: In each step, we remove the node with the smallest be- 
tweenness centrality. The betweenness centrality of node % is defined as follows. De- 
note by u ili2 the number of the shortest paths between nodes %\ and 12, and by cr^^i) 
the number of the shortest paths between them that pass through node i. We set 
a hi2^i) = ^iiiafe) = 0. The betweenness centrality of node i is proportional to 

|25| . Sequentially removing nodes with the 



largest betweenness centrality yielded poor results, and therefore we do not mention 
it in the following. 

Optimal sequential strategy: We calculate the change in A2 induced by the removal of 
each node by direct numerical simulations. Then, we select the node whose removal 
increases A2 by the largest amount. Note that this strategy is computationally costly 
because it requires the calculation of A2 for N different networks, each having N — 1 
nodes. Calculating A2 for a single network requires 0(N 3 ) time. Therefore, carrying out 
a single step of the optimal sequential strategy requires 0(iV 4 ) time. 

Perturbative strategy: To avoid the computational cost of the optimal sequential strategy, 
we develop an approximate perturbative strategy defined as follows. Related perturbative 



calculations are treated in 
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26]. 



Let us represent the eigen equation for A2 as Lu = X2U, where u is the N- dimensional 
eigenvector of L corresponding to A2. The eigenvector u is normalized such that 
YliLi u f = 1' where U{ is the zth element of u. The eigen equation after the removal 
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of node % is given by 

(L + AL)(u + Ait) = (A 2 + AX 2 )(u + Au), (1) 

where the changes in L, A 2 , and u induced by the removal of node % are denoted by 
AL, AA2, and Ait, respectively. Because L is symmetric, the displacement matrix AL is 
given by (AL)« = -L« = -A*, (AL)# = L^j 7^ z), and (AL)^ = (AL)^ = -L^j ^ i). 
Because the ith component of u+Au is equal to zero, we write Ait = 5u—Uie.i, where is 
the unit vector for the ith component and 8u is an iV- dimensional vector. By multiplying 
the normalized left eigenvalue it T (T denotes the transpose) from the left of Eq. ([I]), we 
obtain 

_ u T AL(u - UiBi + Su) , . 

AA 2 — T7 ' — 1 r \ — \ z ) 

u 1 (it — u,jej + oit) 

We assume that the absolute value of each element of 5u is smaller than that of it — itjej. 
Then, by ignoring 8u in Eq. (J2]) and substituting the expression for AL in Eq. fl5]), we 
obtain 



AA 2 « ^ n , (3) 
1 - uj 

where Mi indicates the neighborhood of node %. 

In the perturbative strategy, we remove node % that maximizes A\ 2 given by Eq. Q. Note 
that carrying out one step of the perturbative strategy requires solving the eigen equation 
just once. Therefore, the computation cost is 0(iV 3 ), which is N times smaller than that 
for the optimal sequential strategy. In the following numerical simulations, the networks 
are connected during sequential node removal for all the networks and strategies. 

III. RESULTS 

In this section, we apply the node- removal strategies introduced in Sec. [TT] to various model 
and real networks. 

A. Model networks 

First, we apply different strategies to the following types of model networks. 

• Erdos-Renyi (ER) random graph with mean degree (k) = p(N — 1), where p is the 
probability that a link exists between a pair of nodes. 



Watts-Strogatz (WS) model [27J, where each node is connected to (k) /2 closest nodes on 
each side along the ring and a fraction, 0.3, of links are rewired randomly. 



Barabasi- Albert (B A) model [28( , a representative growing scale- free network model. We 
start the growth of the network from the complete graph of m nodes and add a node 
with m links one- by-one according to the preferential attachment. We obtain (k) m 2m, 
degree distribution p(k) oc k~ 3 , and low clustering. 



Holme-Kim (HK) model [29(, a growing scale-free network model. The algorithm of the 
HK model is similar to that of the BA model. The difference is that, when a node is 
added, the preferential attachment is used with a certain probability, which we set as 
0.5. With the remaining probability (i.e., 0.5), we use the so-called triad formulation rule 
to enhance clustering. We obtain (A;) ~ 2m, degree distribution p(k) oc A; -3 , and high 
clustering. 



Goh model 30j, a nongrowing scale- free network model. We assign the weight Wi = i~ ' 5 
to each node i. Then, we select a pair of nodes with the probability proportional to 
and connect them. We repeat this procedure until we obtain the desired mean degree 
(k). We obtain p(k) oc k~ 3 . 

For each network model, we assume two values of (k). For each case, we carry out sequential 
node removal according to different strategies. Because, in stepwise node removal, the optimal 
sequential strategy is usually an efficient way, we will mainly evaluate the effectiveness of the 
other strategies using the performance of the optimal sequential strategy as a baseline. 

The numerical results obtained for the networks with N = 250 averaged over 10 trials are 
shown in Fig. [TJ Figures [T]( a) (1) and 1(a)(2) show the values of A2 after removing a fraction of 
nodes for two ER random graphs with different values of (A;). The fraction of the removed nodes 
is denoted by /. For each strategy, A2 increases slightly in the early stages (i.e., < / < 0.05). 
Then, A2 starts to decrease even for the optimal sequential and perturbative strategies, which 
are designed to maximize A2. Surprisingly, in the network with larger (k) (Fig. [T](a)(2)), the 
optimal sequential strategy is not as efficient as the other strategies as / increases. This is 
possible because the optimal sequential strategy finds the stepwise best strategy and does not 
take into account the performance after multiple nodes are removed. The perturbative strategy 
remains more efficient or as efficient as the optimal sequential strategy when / is large. 
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For the WS model with different mean degrees (Fig. [TJb) (1) and 1(b)(2)), the optimal 
sequential and perturbative strategies outperform the heuristic degree-based and betweenness- 
based strategies. As in the case of the ER random graph, the perturbative strategy is as efficient 
as the optimal sequential strategy. 

The performances of the perturbative strategies are also good among the competitive strate- 
gies for different scale-free network models (Fig. [1(c)(1), 1(c)(2), 1(d)(1), and 1(d)(2)). In Goh 
model(Fig. [[(e)(1) and 1(e)(2)), thought it is not better than the degree-based strategy, the 
perturbative strategy is better than the optimal sequential strategy except for in the early stage 
(i.e. < / < 0.3) in the Goh model with the smaller degree (Fig. [1(e)(1)). Note that for the 
three scale-free network models, A2 continues to increase even until half the nodes are removed. 

Changes in (k) and the standard deviation of the degree with node removal according to 
the perturbative strategy are shown in Fig. Ufa) (3), 1(a)(4), 1(b)(3), 1(b)(4), 1(c)(3), 1(c)(4), 
1(d)(3), 1(d)(4), 1(e)(3), and 1(e)(4). The direction of changes in (k) and that of the standard 
deviation of the degree depend on the network model. For example, in the Goh model, nodes 
with small degree are preferentially removed in general, especially for small / (Fig. 11(e)(3)). 
However, the removed nodes are not generally those with the smallest degrees; the degree-based 
strategy performs relatively poorly (Fig. [1(b)(1), 1(b)(2), 1(c)(1), 1(c)(2), 1(d)(1), 1(d)(2), 
1(e)(1), and 1(e)(2)). In contrast, in the ER, WS, BA, and HK models, the perturbative 
strategy removes nodes with appropriately large degree (Fig. [1(a)(3), 1(b)(3), 1(c)(3), and 
1(d)(3)). Similarly, the perturbative strategy increases A2 by increasing the heterogeneity 
of degree in the WS model (Fig. [1(b)(4)) and by decreasing the same heterogeneity in the 
other four network models (Fig. [1(a)(4), 1(c)(4), 1(d)(4), and 1(e)(4)). These show that the 
perturbative strategy adapts itself for each network. 

Next, we compare the efficiency of different strategies on larger networks (N = 2000). We 
exclude the optimal sequential strategy because the large N hinders its implementation. In this 
set of numerical simulations, we are mainly concerned with the performance of the perturbative 
strategy. The numerical results obtained on the basis of 5 realizations of each network are shown 
in Fig. [2j These results are qualitatively the same as those obtained for the smaller networks 
shown in Fig. [TJ The perturbative strategy enhances A2 more efficiently than the other heuristic 
strategies except in ER models. In addition, the behavior of the perturbative strategy cannot 
be simply captured by the changes in (A;) or the standard deviation of the degree, which is 
again qualitatively the same as the results shown in Fig. [TJ 
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B. Real networks 



We apply the proposed strategies to the 



networks: the C. elegans neural network 



31 



argest connected component of the following real 



network 



32| . E. coli metabolic network 



331 ] . e-mail social 



341 ] . and macaque cortical network |35J. We ignore the direction of links in the C. el- 



egans neural network and the macaque cortical network, both of which are originally directed 
networks. In the C. elegans neural network, two neurons are regarded to be connected when 
they are connected by at least one chemical synapse or gap junction. 

The efficiency of different strategies on these real networks is shown in Fig. |3] The perturba- 
tive strategy enhances A2 more efficiently in all the tested real networks than the degree-based 
and betweenness-based strategies. Except in the case of the E. coli metabolic network, which 
is too large for the optimal sequential strategy, the results for the optimal sequential strategy 
are shown as well (Fig. El^a), El^c), and|3(d)). The perturbative strategy performs roughly as 
well as the optimal sequential strategy in these networks. 



C. Comparison to the rewiring strategy 

One can alternatively enhance A2 by rewiring links In the rewiring strategy, we 

sequentially rewire links to increase A2. In each step, we examine the increase in A2 for all 
the possible patterns of single-link rewiring and adopt the one that increases A2 by the largest 
amount. To compare the performance of the node removal and the rewiring, we carry out 
numerical simulations using the ER and BA models with N = 50 and (k) = 4. We simulate the 
rewiring process just once for each network because the rewiring strategy is computationally 
costly. 

The change in A2 relative to the initial value during the rewiring process is shown in Fig. Ufa). 
A2 is enhanced up to about 1.7 fold for both networks. The corresponding results for the 
sequential node removal according to the perturbative strategy are shown in Fig. S(b). Roughly 
speaking, the performance of the perturbative strategy is comparable to that of the rewiring 
strategy. The perturbative strategy is superior to the rewiring strategy for the ER model and 
vice versa for the BA model. Because the rewiring strategy is computationally costly and may 
be too demanding to be implemented in some real applications, the node removal according to 
the perturbative strategy seems to be a feasible choice for enhancing A2. 
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D. Accuracy of the perturbative strategy 

When deriving the perturbative strategy, we crucially assumed that 8u is negligible as 
compared to u — UiBi. We justify this assumption as follows. A node that is removed according 
to the perturbative strategy tends to have large AA2 and a small degree. If the removed node 
has a small degree, the number of the nonzero entries of the corresponding AL is relatively 
small. Therefore, a relatively small number of the entries of u would be directly affected by 
the node removal, and we would obtain a small Su. 

To probe the validity of this assumption and quantify the error in estimating AA2, we 
measure two kinds of relative estimation error during the course of sequential node removal 
according to the perturbative strategy. The first quantity is the average of \(Su)j/(u — Ui(ii)j\ 
over node j(l<j<N,j^i), where i is the index of the removed node. The second 
quantity is the difference between AA2 obtained from the perturbative strategy and the actual 
AA 2 , which is normalized by the actual AA 2 . We take averages of these quantities over 200 
generated networks having N = 250. 

For the five network models, \(5u)j/(u — Uie.i)j\ for (k) = 10 and (k) = 40 is shown in 
Fig. [5](a) and[5](b), respectively. The magnitude of 5u relative to that of u — Ui&i is sufficiently 
small. The relative estimation error in AA2 for the removed nodes is shown for (k) = 10 and 
(k) = 40 in Fig. 0(c) and 0(d), respectively. As expected, the relative estimation error in AA 2 
is generally small. We conclude that, up to our numerical efforts, the perturbative strategy 
does not suffer from a crucially large error. 

IV. CONCLUSIONS 

We explored efficient strategies to sequentially remove nodes of networks in order to increase 
or maintain a large value of the spectral gap (i.e., second smallest eigenvalue of the Laplacian 
matrix) of the undirected and unweighted network. We introduced a perturbative strategy 
among others. For a variety of networks, this strategy generally performed well as compared 
to heuristic strategies in which we sequentially remove the nodes with the smallest degree 
or the smallest betweenness centrality. In most of our numerical results, the spectral gap 
increased until the removal of a fairly large fraction of nodes (~ 50%). Occasionally, the 
perturbative strategy is even more efficient than the optimal sequential strategy, despite its 
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decreased computational cost. Although we focused on unweighted networks, the extension of 
the perturbative strategy to the case of weighted networks is straightforward. 

In chaotic dynamical systems on networks, synchronization is often facilitated by a small 
value of R = where A2 and A a? are the second smallest eigenvalue and the largest eigen- 



value of the Laplacian matrix, respectively. Dynamics w 



by R belongs to the class III [2|, |9| (also termed type I 



rose synchronizability is determined 
4j). In contrast, we have been con- 



cerned with the synchronization of the class II {2, 9] (also termed type II j^]) dynamics in which 
synchronization is facilitated in networks with large A2. To address class III or type I synchro- 
nizability, we developed the perturbative strategy for minimizing R upon the removal of nodes 
and assessed its efficiency on some model networks. However, the results were generally poor 
(results not shown). The perturbative strategy failed mainly because it does not accurately 
estimate the change in A^v- The applicability of our results is limited to class II or type II 
dynamics. 
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FIG. 1: Numerical results for model networks with N = 250 nodes. We set (k) = 10 and (k) = 40 
for each network, (a) ER random graph, (b) WS model, (c) BA model, (d) HK model, and (e) Goh 
model, (a)(1), (a)(2), (b)(1), (b)(2), (c)(1), (c)(2), (d)(1), (d)(2), (e)(1), and (e)(2) show the change in 
A2 induced by each strategy. The mean degrees are shown in the panels, (a)(3), (b)(3), (c)(3), (d)(3), 
and (e)(3) show the change in the mean degree with node removal, (a)(4), (b)(4), (c)(4), (d)(4), and 
(e)(4) show the change in the standard deviation of the degree with node removal. 
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FIG. 2: Numerical results for (a) ER model, (b) WS model, (c) BA model, (d) HK model, and (e) Goh 
model with N = 2000. We set (k) = 10 and (k) = 40 for each network model with one exception. We 
use (k) = 15 instead of (k) = 10 for the Goh model because the Goh model with N = 2000, (k) = 10, 



and Wj 



-0.5 



(1 < i < N) rarely yields a connected network. 




FIG. 3: Numerical results for real networks, (a) C. elegans neural network with iV = 279 and 
(k) = 16.4. (b) E. coli metabolic network with N = 2268 and (k) = 4.96. (c) E-mail social network 
with N = 1133 and (k) = 9.62. (d) Macaque cortical network with N = 11 and (k) = 12.3. 
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FIG. 4: Numerical results for the ER and BA models with N = 50. (a) Results for link rewiring. 
The normalized A2 is plotted against the number of rewired links, (b) Results for node removal. The 
normalized A2 averaged over 10 realizations is plotted against the number of removed nodes. We set 
(k) = 4 in both networks. 
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FIG. 5: (Color online) Relative estimation error in (a, b) 5u and (c, d) AA2- See Sec. IIII Dl for the 
definitions of the relative estimation error. We set (a, c) (k) = 10 and (b, d) (k) = 40. We use (k) = 15 



instead of (k) = 10 for the Goh model because the Goh model with iV = 250, (k) = 10, and Wi 



-0.5 



(1 < i < N) rarely yields a connected network. 



